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Abstract 

The forcing relation of braids has been introduced for a 2-dimensional 
analogue of the Sharkovskii order on periods for maps of the interval. In this 
paper, by making use of the Nielsen fixed point theory and a representation 
of braid groups, we deduce a trace formula for the computation of the forcing 
order. 
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1 Introduction 

The influential statement "Period three implies chaos" of Li and Yorke [21] turns 
out to be a consequence of a much earlier theorem 

Theorem 1.1 (Sharkovskii [23]). On the set of natural numbers, define a linear 
order 

3 ^ 5 ^ 7 > ^ 2 • 3 ^ 2 • 5 > ^ 4 • 3 ^ 4 • 5 > ^8^4^2^1. 

For any continuous map f : [0, 1] — > [0, 1] of the interval, if f has a periodic orbit 
of period n, then f must have a periodic orbit of period m for every m -< n. 

However, in dimension 2 the same statement cannot be true as shown by the 
(2-7r/3)-rotation of the unit disk. It was not until the work of Matsuoka [22] and 
Boyland [5], that the role of braids was revealed in the problem of forcing relation 
of periodic orbits for homeomorphisms of the plane. 
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Figure 1: a geometric braid 



Let / : M 2 — > M 2 be an orientation-preserving homeomorphism and let {h t : 
M 2 — > M 2 }o<t<i be an isotopy with ho = id and hi = f. An /-invariant set 
P = {x\, . . . , x n } C M 2 gives rise to a geometric braid (ref. [3]) 

{(h t (xi),t) | < i < 1, 1 < % < n} 

in the cylinder M? x [0, 1]. Indeed, the closed curve {[h t (xi), . . . , h t (x n )] | < t < 1} 
in the configuration space 

X n = {(xx, ...,x n )\xiE R 2 , Xi ^ Xj, Mi ^ j}/S n , 

where S n denotes the symmetric group of n symbols, gives rise to a braid (3p in 
the n-strand braid group B n = ni(X n ). With another connecting isotopy {h t }, the 
resulting braid ftp may differ by a power of the "full-twist". Matsuoka obtained 
lower bounds for the number of m-periodic points of /|r2\ p , in terms of the trace 
of the reduced Burau representation of the braid (/3p) m . 

Later, Kolev [20] (see also [12]) found that a 3-periodic orbit P guarantees the 
existence of m-periodic orbits for every m, unless the braid ftp is conjugate to a 
power of the braid <Ji<J2- Roughly speaking, this means that the (27r/3)-rotation 
mentioned above is the only exceptional case. Therefore, Li-Yorke's statement still 
holds in a subtle way in 2-dimensional dynamics. The analogue of the Sharkovskii 
order naturally leads to the notion of forcing relation of (conjugacy classes of) 
braids. 

In the following, the notation [/3] stands for the conjugacy class (in the group 
which is specified by the context) of a braid (3. 

Definition 1.2. A braid (3 forces a braid 7 if, for any orientation-preserving home- 
omorphism / : M 2 — > M 2 and any isotopy {ht} : id ~ /, the existence of an 
/-invariant set P with \j3p] = [j3] guarantees the existence of an /-invariant set Q 
with \J3 Q ] = [7]. 

Remark 1.3. There is a homomorphism from the braid group B n onto the mapping 
class group of the pair (R 2 , P) (acting on (IR 2 , P) from the right), its kernel being 
generated by the "full-twist". Via this homomorphism, [j3p] is sent to the conjugacy 
class of the mapping class represented by /, which is independent of the choice of 
the isotopy {h t }. Following Boyland [5] this invariant is referred to as the braid 
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type of (/, P) in the literature. It is clear that the forcing relation of braids defined 
above naturally descends to that of braid types. 

The forcing relation is essentially a problem concerning plane homeomorphisms. 
So the Best vina- Handel theory of train-track maps [2] comes in naturally. By 
analyzing the symbolic dynamics of train-track maps, Handel [14] was able to 
totally solve the forcing relation among 3-strand pseudo-Anosov braids, and de 
Carvalho and Hall [7, 8] have managed to do the same for horseshoe braids. This 
approach is, theoretical speaking, powerful enough to be extended to mapping 
classes of all punctured surfaces. On the other hand, there still is the challenging 
task of recovering the braiding information encoded in the symbolic dynamics. 

In this paper, we take another approach. Besides the Thurston classification of 
surface homeomorphisms, we apply the Nielsen fixed point theory. As a powerful 
tool for studying fixed points and periodic orbits of self maps, Nielsen theory has 
been well developed and successful in many mathematical problems. It turns out 
that there are plenty of coincidences between the notions in the Nielsen theory and 
the forcing theory, providing a more direct bridge between the topological and the 
algebraic aspects of braids. 

We start by slightly expanding the language of forcing. 

Definition 1.4. A braid f3' is an extension of (3 if (3' is a (disjoint but possibly 
intertwined) union of (3 and another braid 7. An extension f3' is forced by (3 
if, for any orientation-preserving homeomorphism / : IR 2 — > IR 2 and any isotopy 
{h t } : id ~ /, the existence of an /-invariant set P with \f3p] = \J3] guarantees the 
existence of an additional /-invariant set Q C M 2 \ P with [/3puq] = [P']- 

The advantage of considering [/3puq] is that it contains the extra information 
of how the forced braid 7 = (3q winds around the original braid (3. 

Our main result is stated as follows. 

Theorem 1.5. Suppose a braid (3' G B n+m is an extension of (3 G B n . Then (3' is 
forced by (3 if and only if (3 1 is neither collapsible nor peripheral relative to {3, and 
the conjugacy class \f3'\ has nonzero coefficient in tr# n+m ( n , m (f3). 

In the theorem, ( ntTn is a matrix representation of B n over a free Z5 n+m -module, 
and the trace trg n+m is meant to take value in the free abelian group generated 
by the conjugacy classes in B n+m (see Section 4). In addition, (3' is said to be 
collapsible or peripheral relative to (3 if, roughly speaking, some strands of f3' may 
be merged or moved to infinity while keeping j3 untouched (see Definition 3.3 and 
the figures therein). 

Thus, to obtain the (n + m)-strand forced extensions of a braid (3 G B n , it 
suffices to compute the trace trp n+m Cn,m{ft) an d then drop off certain irrelevant 
terms. 
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The paper is organized as follows. In Section 2, we propose a Nielsen theory 
tailored to finite invariant sets of self embeddings. In Section 3, we apply this 
Nielsen theory to the forcing problem of braids and reduce it to the computation 
of a generalized Lefschetz number. In Section 4, the representation C n m is defined 
and a trace formula for the generalized Lefschetz number is derived. Section 5 is 
devoted to the proof of Theorem 1.5. In the final section, we discuss the algorithmic 
aspects of the trace formula and show some concrete examples. 

The authors want to express their gratitude to the referee for comments on the 
exposition, which motivated an extensive revision. 

2 Nielsen theory 

2.1 Nielsen fixed point theory 

Throughout the paper all maps between topological spaces are assumed to be 
continuous. The material in this subsection is standard, see [15, 16]. We assume 
that X is a compact, connected polyhedron and / : X — > X is a self map. 

Consider the mapping torus Tf = X x t + 1) ~ (f(x),t) of /. Denote by 

T the fundamental group of Tf and by T c the set of conjugacy classes of T. Then 
T c is independent of the base point of Tf and can be regarded as the set of free 
homotopy classes of closed curves in Tf. 

Note that x £ Fix / if and only if on the mapping torus Tf its time-1 orbit curve 
{[%, t] | < t < 1} is closed. Define x, y £ Fix / to be in the same fixed point class 
if and only if their time-1 orbit curves are freely homotopic in Tf. Therefore every 
fixed point class F gives rise to a conjugacy class cd(F) in T, called the coordinate 
of F. A fixed point class F is called essential if its index ind(/, F) is nonzero. 

The generalized Lefschetz number is defined as 

L r (/) = ^ind(/,F)-cd(F)£Zr c 

F 

which takes value in the free abelian group Zr c generated by r c . 

The number of nonzero terms in Lr(f) is called the Nielsen number of f. It is 
the number of essential fixed point classes, a lower bound for the number of fixed 
points of /. 

Generalized Lefschetz number is a homotopy invariant, i.e. if / ~ g : X — > X 
then, identifying the fundamental groups of Tf and T g in the standard way, we 
have L r (f) = L v {g). 

2.2 Stratified maps 

The Nielsen theory for stratified maps is a version of relative Nielsen theory. Read- 
ers are referred to [18] for a detailed treatment of this subject. 
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Definition 2.1. Let W be a compact, connected polyhedron and let = W° C 
W 1 C • • ■ C If™" 1 C jy m = W be a filtration of compact subpolyhedra. For 
1 < k < m, the subspace Wk = W k \ W k ~ x is called the fc-th stratum. A map 
/ : W — > W is called a stratified map if /(W^) C VFfc for all strata W^. Two 
stratified maps f,f':W—>-W are called stratified homotopic if there is a homotopy 
of stratified maps {/i f : H 7 — > W}o< t <i such that ho = f, h\ = f. 

We will be concerned with fixed point classes of f m — f\w m '■ W m W m in the 
top stratum. A free homotopy class of closed curves in T/ m , represented by a closed 
curve 7, is said to be related to a lower stratum Wk if there is a homotopy of closed 
curves {7^ : [0, 1] — > T/}o< s <i such that 70 = 7, each j s is in Tf m for < s < 1, 
and 7x is in T f \ Wk . 

Definition 2.2. A fixed point class of f m is called degenerate if its coordinate is 
related to some lower stratum Wk- Otherwise, it is called non- degenerate. 

Every non-degenerate fixed point class of f m is a compact subset of W m , hence 
its fixed point index is well defined. 

Denote by T the fundamental group of Tf m and by T c the set of conjugacy 
classes in T. The generalized Lefschetz number of the stratified map / is defined as 

L r(/) = ^ind(/ m ,F m ) • cd(F m ) e ZT C 

where the sum is taken over all non-degenerate fixed point classes F m of f m . 

The Nielsen fixed point theory has a natural version for stratified maps. The 
main result is that L-p(f) is not changed by a stratified homotopy of the map /. 

The following theorem will play an important role in the analysis of the forcing 
relation of braids. Suppose S is a compact, connected, orientable surface and we 
consider homeomorphisms of S as stratified maps with respect to the filtration 
C dS C S. 

Theorem 2.3 (Jiang-Guo [17], Boyland [6]). Every orientation-preserving home- 
omorphism f : S — > S is isotopic ( through homeomorphisms ) to a homeomorphism 
(p such that, for any n > 1, any fixed point class of <fi n is essential and contained 
in a single <fi-orbit and, moreover, no fixed point class of n |i n ts is related to dS. 

In the theorem, the 0|i n ts-orbits persist under isotopy, i.e. none of them can 
be merged or be eliminated by isotoping the homeomorphism 0|i n ts. In particular, 
flints has the minimal number of periodic orbits of period n in its isotopy class for 
every n > 1. In the rest of this paper, we will refer to the homeomorphism 4>\- m ts 
as a minimal representative in the isotopy class of /|i n ts- 
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2.3 A Nielsen theory for finite invariant sets 

In this subsection, assume X is a compact, connected, smooth manifold of dimen- 
sion d and / : X — > X is a self embedding. 

Let m be a fixed natural number. Consider the symmetric product space 

SP m X = {( Xl ,...,x m ) \x l eX}/Y, m . 

Its points will be written ], with repetitions allowed. For an integer 

k, < k < m, define the subspace 

spm , k X = {[x 1 ,...,x m }eSP m X\\{x 1 ,...,x m }\<k}. 

Then we have a filtration 

= SP m '° X C SP™' 1 X C ■ • • C SP m,m_1 X C SP m ' m X = SP m X. 

The top stratum is sometimes called the deleted m-th symmetric product space 
and denoted 

DSP m X = SP m X \ SP m,m " 1 X. 

For 1 < k < m, the fc-th stratum is W k = SP m ' fe X \ SP m ' k ~ l X. 

Remark 2.4. Each stratum W k is a manifold of dimension k ■ d. When d = 2, which 
is our main concern later, the m-th symmetric product SP m X itself is a manifold 
of dimension 2m. 

The map / : X -> X induces a map SP m / : SP m X -> SP m X given by 
gpm yQ ;Cl) _ _ _ j Xm j) = [/(xi), . . . , /(x m )]. Since / is an embedding, SP m / is now a 
stratified map with respect to the above filtration. Hence the theory in the previous 
subsection is applicable. 

Observe that a fixed point [x\, . . . , x m ] of DSP m / = SP m f\nsp m x corresponds 
to an /-invariant set consisting of precisely m distinct points. Thus, the number 
of non-degenerate, essential fixed point classes of DSP m / is a lower bound for the 
number of such /-invariant sets, for all embeddings isotopic to /. 

Below is a useful criterion for the degeneracy of a fixed point class of DSP m /. 

Proposition 2.5. Suppose X is a compact, connected, smooth manifold of dimen- 
sion d and suppose f : X — > X is a self embedding. Let Q = {xi, . . . , x m } C X be 
an f -invariant set. Let D denote the disjoint union of k copies of the d-dimensional 
disk, 1 < k < m. The coordinate of the fixed point [xx, . . . , x m ] of DSP m / is re- 
lated to the k-th stratum W k if and only if there exists an isotopy of embeddings 
{i t : V —> X} <t<i such that io = f ° ii, Q C it(T>) and each component of i t {V) 
contains at least one point of Q, for all < t < 1. 
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Proof. Sufficiency is clear: we can use the tubes {(x,t) \ x G iti'D), t G [0,1]} 
to construct a homotopy which relates the time-1 orbit curve of [x±, . . . , x m ] to a 
closed curve in the mapping torus of SP m f\w k - 

Necessity Let {7^ : [0, 1] — > T SP ™ /} se [o,i] be a homotopy of closed curves, 
relating the time-1 orbit curve 7 of [xx,...,x m ] to a closed curve lying in the 
mapping torus of SP m f\w k - By sliding along Tsp™ /, we may assume that j s (t) = 
[[zi(s, t), . . . , z m (s, t)], t], where Zj(s,t) are continuous functions of s,t. Put Q Sjt = 
{Zj(s,t) I 1 < j < m} C X. Then Qo jt = Q and Q sfi = f(Q s ,i). 

Since there are precisely k distinct elements in Qi jt , if = Zj 2 (l,t) holds 

for some t then it holds for all t. Therefore, we may choose an isotopy of embeddings 
{i' t : T> — > X}te[o,i] such that i' = f o i' x and each component of i' t (T>) contains 
precisely one point of Qi,t- Extending {i' t } to a two-parameter isotopy {i" t : V — ► 
^}s,te[o,i] sucn ^at ij t = i' t , i" — f o i" x and Q Sjt C i" t (V), we get the desired 
isotopy {z t = : P -> X} te[0 ,i]- □ 

Definition 2.6. In Proposition 2.5, the components of io(T>) containing more than 
one point of Q are called merging disks of Q. 

Remark 2.7. The existence of merging disks of Q means the /-invariant set Q can 
be merged into a smaller one by isotoping / in a neighborhood of these disks. 



2.4 Index formulae 

The next two lemmas may be found in [15]. 

Lemma 2.8. Suppose x is a generic fixed point of f : X — > X , i.e. f is differen- 
tiate at x with Jacobian A such that det(I — A) 7^ 0. Then x is an isolated fixed 
point and ind(/, x) = sgndet(J — A). 

Lemma 2.9. Suppose x and y are isolated fixed points of f : X — > X and g : Y — ► 
Y , respectively. Then ind(/ x g,x x y) = md(f,x) ■ ind(g,y). 

Lemma 2.10. Let f : (W l ) h (R n ) k be a map defined by 

(xi, . . . , x fc ) i-> (/2O2), • • • , fkM, AOi)) 

1 — > W n are a family of maps, each admitting the origin G W 1 



) is an isolated fixed point of f, then 



where /1, . . . , f k : M n - 
as a /ixec? point. If the origin 
ind(/,0)=ind(/ 1 o...o/ fc ,0). 

Proof. It suffices to consider the case of generic fixed points. Denote by A±, 
the Jacobians of /1, ••-,/& at 0. Then the Jacobian of / at is 



A k 



( 



A 2 




\ 



.4 



^3 
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Therefore, 

ind(/,0) =sgndet(/-A) = sgndet(J-Ai--.A fc ) =ind(/io...o/ fc ,0). □ 
The following lemma is prepared for the proof of Proposition 4.3. 

Lemma 2.11. Let A > 1 be a real number and let B = (Bij) be an m x m matrix 
with 

(-i)% v(j) = i, 



13 I 0, V (j) ± i, 

where n±, . . . ,n m G Z are a set of integers and t] e S m is a permutation. For a 

I XB 

generic fixed point x of a map f : R 2m — > lR 2m with Jacobian A = 
we have 

ind(/,x) = (-l) m (-l) ni+ - +nm sgnr/. 



X~ l B 



Id > 



Proof. We may assume rj is a cycle. Then 

det(J - A) = (1 - (-i)"i+-+™™A m )(l - (_i)"i+-+^A- m ). 

Hence 

ind(/,x) = sgndet(7 - A) = = S gn r/. □ 

3 Forced extensions of a braid 

In this section, we apply Nielsen theory to the problem of forcing relation of braids. 
It turns out that the mapping tori involved here are naturally embedded into the 
defining configuration spaces of braid groups, and the coordinates of the fixed 
points can be readily interpreted as forced extensions. 

3.1 Coordinates recognized as braid extensions 

Let <7i, . . . , cr n _i denote the standard generators of the Artin's n-strand braid group 
B n (ref. [3]) and let A i; j, 1 < i < j < n, denote the standard pure braid 

a ~ ~ ~2 -1 -1 

Let P C M 2 be a prescribed set of n punctures. Define the configuration spaces 
X n = {{xt, ...,x n ) | Xi e M 2 , Xi ^ Xj, Vi ^ 

^n,m = {(^lj • • • ) ^n+m) | %i £ K , Xi ^ Xj, Vi ^ X S m , 

y n , m = {(?/!,..., y m ) | yi e K 2 \ P, yj, Vi 7^ j}/S m . 
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i i + 1 



,1 



(b) 



Figure 2: the standard braids (a) <7j and (b) A. 



Clearly y n<m embeds into X n>m via [y u . . . , y m ] [P, y h . . . , y m ], and Af n>m projects 
onto ^ via [xi, . . . , x n , x n+1 , x n+m ] i-> [x 1 ,...,x n ]. Then 3^ is precisely the 
fiber of the bundle tt : X nm — > X n and we have 

Ki(X n ) = B n , 

Ki(X n>m ) = (<7i, . . . , <r n _i, a 2 , 0" n+ i, . . . , a n+m -i) C B n+m , 

Kl(y n ,m) = (Ai ) C 7Ti(#n )m ). 

Given a nontrivial n-strand braid (3, "sliding the plane down the braid (3" 
determines (up to isotopy) a homeomorphism fp : IR 2 \ P — > R 2 \ P, as well as a 
connecting isotopy : IR 2 — > M 2 }o<t<i : id ~ //? such that the curves {/it(-P)}o<t<i 
represent the braid j3. 

Now we figure out our key observations. 

Proposition 3.1. (1) The mapping torus of the induced map DSP m fp : y n ^ m — > 
3^n,m can be identified with the space obtained from 

{([h t (P), yi ,...,y m ],t) \ yi eR 2 \h t (P), 0<t<l}cX n<m x [0,1] 

by identifying the top y n , m x with the bottom y n>m x 1- 

(2) Under the above identification, the fundamental group ^p >m of Tdsp™ fa is 
the subgroup in B n+m generated by (3 and 7r 1 (3^ n ,m); where (3 is regarded as an 
(n + m) -strand braid with m trivial strands added. 

(3) Moreover, when a fixed point o/DSP m fp corresponds to an f p-invariant set 
Q C M 2 \ P , the coordinate of the former is precisely [/?puq]- 

Proof. (1) The identification is realized by the embedding 

y n , m x [o,i] x njm x [o,i], 

([P, Z/i, • • • , Vm],t) i-> ([h t (P), ht(yi), . . . , h t (y m )],t). 
(2) and (3) follow from (1). □ 
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3.2 Compact ificat ion 

By Proposition 3.1, the coordinates of the fixed points of DSP m fp are naturally 
interpreted as {n + m)-strand extensions of (3. However, DSP m fp is a self map of 
a noncompact space, hence falls out of the framework of the usual Nielsen fixed 
point theory. 

So, we apply instead the theory in Section 2.3. For this, we compactify IR 2 \ P 
to a 2-disk with n holes and denote it by Y n , and assume further that fp = /Ji n ty n 
for some homeomorphism fp : Y n — > Y n . 

Consider the symmetric product space SP m Y n and the induced stratified map 
SP m J f3 : SP m K„ SP m K„ with respect to the filtration SP m '° Y n C SP m>1 Y n C 
• • • C SP m,m Y n . Note that the interior of the manifold DSP m Y n is precisely y n>m . 
In particular, 7Ti(DSP m F n ) = ni(y n ,m) and 7ri(T DSpm j^) = 7ri(T DSP m ffj ) = Tp tTn . 

The stratified map SP m fp is actually the desired compactification of DSP m fp. 
But some more fixed points may arise on the boundary of the manifold DSP m Y n . 
Hence the generalized Lefschetz number Ly p m (SP m fp) may contain unwanted 
terms (called "peripheral" terms) which should be identified and ruled out. 

In addition, the coordinates of degenerate fixed point classes of DSP m fp also 
need to be identified in the computation of L-p^ m (SP m fp). These considerations 
lead to the notions of the next subsection. 

3.3 Collapsible and peripheral extensions 

Recall the Thurston classification theorem for homeomorphisms of compact sur- 
faces. The theorem has a natural version for punctured surfaces, even for punctured 
planes by regarding the plane as a once-punctured 2- sphere. 

Theorem 3.2 (Thurston [10, 24]). Every homeomorphism f : S — > S of a compact 
surface S is isotopic to a homeomorphism (f> (Thurston representative) such that 
either 

(1) (f) is a periodic map, i.e. <p k = id for some positive integer k; or 

(2) cf) is a pseudo-Anosov map, i.e. there is a number A > 1 and a pair of trans- 
verse measured foliations (F s ,fi s ) and (F u ,fi u ) such that <p(F s ,fi s ) = (F s , A _1 /i s ) 
and 0(F U ,^) = (F u , \^ u ); or 

(3) cf) is a reducible map, i.e. there is a system of disjoint simple closed curves 
7 = {71, . . . , 7^} in int S (reducing curves) such that 7 is invariant by (f) (but 7, 's 
may be permuted) and 7 has a ^-invariant tubular neighborhood U such that each 
component of S \ U has negative Euler characteristic and on each ^-component of 
S\U, (f> satisfies (1) or (2). 

Every braid determines a unique isotopy class of homeomorphisms of a punc- 
tured plane. In this way, the braids naturally fall into three types: periodic, pseudo- 
Anosov and reducible. 
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Definition 3.3. Suppose ft' £ B n+m is an extension of ft £ _B n . Let be a Thurston 
representative determined by /?'. We say ft' is collapsible (resp. peripheral) relative 
to /? if there exists a system of reducing curves of such that one of them encloses 
none of (resp. precisely one of or all of) the punctures corresponding to ft. 




Figure 3: (a) collapsible and (b,c) peripheral braids relative to the solid braid 



Definition 3.4. If an extension ft' £ ft ■ iri(y nm ) of a braid (3 £ B n is collapsible 
(resp. peripheral) relative to ft, then we say the conjugacy class [ft'] in Vp jTn is 
collapsible (resp. peripheral). 

3.4 Forced extensions 

We are ready to state the main result of this section. 

Proposition 3.5. Suppose ft £ B n is a nontrivial braid. The (n + m) -strand forced 
extensions of ft are exactly the non-peripheral terms in L Tjj m (SP m fp). 

Proof. Thanks to the homotopy invariance of generalized Lefschetz number, let us 
assume f/3 = fp\mtY n : M 2 \ P ^ IR 2 \ P is a minimal representative (in the sense 
of Theorem 2.3) in its isotopy class. 

On the one hand, a fixed point [x\, . . . , x m ] of DSP m fa falls out of y n ,m if and 
only if some Xi falls into dY n , and this is equivalent by the minimality of fp to that 
the coordinate of the fixed point is peripheral. 

On the other hand, the fixed point class represented by a fixed point [x\, . . . , x m ] 
of DSP m / g lying in 34,m is non-degenerate; otherwise, by Proposition 2.5 the fp- 
invariant set {x±, . . . ,x m } can be merged into a smaller one (cf. Remark 2.7), in 
contradiction to the minimality of fp. 

It follows that the non-peripheral terms in Lr m (SP m / p) are precisely the co- 
ordinates of the fixed points of DSP m fp = DSP m f p\y n , m , which by the minimality 
of fp again are exactly the {n + m)-strand forced extensions of ft. □ 

From the theoretical point of view, constructing a minimal representative in 
the isotopy class of fp is not an easy task. However, by the homotopy invariance 
of generalized Lefschetz number, we can compute Lr^ m (SP m fp) from any map 
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stratified home-topic to SP m fa. This is exactly what we will do in the next section. 
The following lemma is prepared for this purpose. 

Lemma 3.6. Let g : Y n — > Y n be an embedding isotopic to f p and let Q = 
{xi, . . . , x m } be a g-invariant set. Then the fixed point class o/DSP m g represented 
by [xi, . . . , x m ] is degenerate if and only if its coordinate is collapsible. 

Proof. There is an obvious correspondence between the merging disks of a g- 
invariant set and the reducing curves defining the notion of collapsibility. □ 

4 A trace formula for L r/3m (SP m fp) 

In this section, we define a representation £ n m of B n over the free (left) "LB n+m - 
module generated by 

£n,m = {/i = (/il, • • • , Hn-l) \ V>i G ^>0, A*H h = ™}> 

and derive a trace formula for L r/3 m (SP m fp) . The size of the basis £ n ,m is ( m4 ^~ 2 ) • 
4.1 Braid actions on Y n 

We decompose the surface Y n into an annulus and n — 1 rectangles, as shown in 
Figure 4. Let U — U\ U • • • U U n _\ be the union of the n — 1 foliated open rectangles. 
Define an ordering on U such that x\ -< X2 if either X\ lies in a rectangle to the right 
of X2 or X\ lies in a strictly lower leaf of the same rectangle as x%- For example, 
the order of the three points in Figure 4 is x\ -< X2 -< £3. 













^3. 


















— &t*- 




-Ur- 











Figure 4: decomposition of Y n 

Set 

V = {[Xi, ...,X m ] G ^n,m I £ f/, Xi -< ■ ■ ■ -< X m }. 

Then V = I J, cP V u where 

Vf, = {[xi, . . . ,x m ] G V I |{xi, . . . ,x m } n = //j, 1 < % < n - 1}. 

Each V M is connected, thus the elements of £„ im are in one-one correspondence to 
the components of V. 
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r 



f 

HA) 



HA) UUi) 

Figure 5: the embeddings fa : Y n — > Y n and fa : Y n — > F n 



Illustrated in Figure 5 are two embeddings fa : y ra — > K„ and 0j : F n — ► F n , which 
can be understood as the action of the elementary braids <7; anda" 1 on Y n , respec- 
tively. Both push the annulus outward, irrationally rotate the outmost boundary, 
keep the foliations of <p~ l (U) or cf)^ l {U), uniformly contract along the leaves of the 
foliations and uniformly expand along the transversal direction. Slightly abusing 
notations, we also use fa and fa to denote the induced stratified maps of SP m Y n . 

For every <f> G {fa, . . . , <f> n _ u fa,..., 4> n -i}, we have 

v„n<tr\v v )= |J wj£, 

where 

wM = {[x 1 ,...,x m ]eV li n<l>- 1 (V v ) 

Each wj£i) is connected, thus the elements of the set {77 G E m | W^tli 7^ 0} are in 
one-one correspondence to the components of H 0~ 1 (V iy ). 

Further, as shown in Figure 6, choose a base point b = [bi,...,b m ] G y n ,m- 
Then the generators a n+ j and v4 i n+1 of Tri(y n>m ) are represented by the loops 
[61, . . . , bj-!,pj, qj, b j+2 , ...,b m ] and [r h b 2 , . . . , b m ], respectively. 

For every x — [x±, . . . , x m ] G V with x\ -< • • • -< x m , the disjoint "descending" 
paths connecting bk to Xk in Y n give rise to a path j x in 34,m- Similarly, the disjoint 
"ascending" paths connecting bk to fabk) give rise to a path 7^) in y n>m . For every 
nonempty wjiflj, we choose a point x G and let a^tl? denote the element of 



faxt) -<•■■-< fax m ) 
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Ui-A I U l U l+ i U n -\ 



<f{bj+i) 4>{bj) 4>{h) 4>(bi) 




Pi 6 2 



i+1 



£2 



Figure 6: paths in Y n 

niiy^m) represented by the loop 7^) ■ 4>( , y x ) ■ l^Ly Note that a>ffi v is independent 
of the choices oix,j x , 7^) and 7^). 



4.2 The representation £ n m 
Proposition 4.1. T/ie equations 



where 



■1)"' • <7< ■ ^ sgn 



?7 • a; 



77 • 



give rise to a group representation ( ntm of B n over the free ZB n+m -module generated 

Proof. Direct proof of this proposition is rather complicated. We refer the reader 
to [25] for another representation £ n m of B n with the same basis £ n ,m and with the 
same coefficient ring ZB n+m . Let a^l, bfy denote the matrix elements of £ n ,m(o"i), 
Cn.mC^i -1 )' respectively. Then a direct computation shows that cfy = and 
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dfy = (cLul)*, where * : ZB n+m — > 'LB n+m is the involution determined by a* = a 1 
for a G -B n +m- Therefore, Cn,m is precisely the dual representation of £ n>m . □ 

The computation of cfy, dfy is straightforward and we state the result as follows. 

For each permutation t] G £ m , there exists a unique positive permutation braid 
(a positive braid that has a geometric representative where every pair of strands 
crosses at most once, see [9]) a v G ni(y n ,m) C B n+m in which the last m strands 
are permutated in the manner of rj. Set rf 1 = sgnr/ • [a n ) ±l . 

For integers 1 < % < j < k < I < m, let 9ij,k,i G S m denote the permutation 
that sends the sequence i + 1, i + 2, . . . , I to 



fc + l,fc + 2,...,Z, k,k-l, + i + l,i + 2,...,j. 



Also set 



and 



77(1) =i, Vz ^ j + 1,j + 2,...,Z, 
r/(j + 1) < 77(j + 2) < •■■ < ?7(fc), 
r](k + 1) < ri(k + 2) < ■ ■ ■ < 7/(7) 

For integer 1 < i < n — 1 and elements \i = . . . , /i n _i), z/ = (z/ 1; . . . , ^ n _i) G 
and d]S do not vanish if and only if < z/j_i, < z/ i+ i and /i^ = ffc 
for all k ^ i — 1, i, i + 1. In this case, 

/•(*) (—■\Y i n( IT 4- ,1/9+ ft+ f) + 

^ ' *\ 11 ^>"+k / u ^+i,Di+i,'y I ,'y I w ^,« I ,'u I -.i w Di + 2,« I +i,^+i' 



^fc=M i + l + l ' 

fc=i; i+ i + l 



-1 



where ttj = 2^, . and = }^ k=j v k . 



4.3 The trace formula 

Definition 4.2. Let T be a group, Zr its group ring, T c the set of conjugacy 
classes, ZT C the free abelian group generated by T c and iir '■ Zr — > Zr c the obvious 
projection. Suppose ( is an endomorphism of a free Zr-module such that ({vi) = 
Y^j=i a ij ' v j f° r a basis {vi, . . . , f fc}. The irace of ( is defined as 

k 

tr r C = 7rr(^ctii) e Zr c . 
i=i 

It is straightforward to verify that the definition is independent of the choice of the 
basis. 
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Note that, under the basis £ n ,m, all matrix elements of Cn,m{P) belong to 2Tg im . 
Therefore, ( n ,m(P) can be naturally regarded as an endomorphism of the free Zr^ m - 
module generated by E n{m . In this way, the notation trp m Cn,m{P) m the following 
proposition makes sense. 

Now we prove the main result of this section. 

Proposition 4.3. For every nontrivial braid f3 e B n , we have 

L T ,JSP m J p ) = (-l) m tTr Pim CnM - collapsible terms. 

Proof. Choose a word j3 = T\ ■ ■ -r^ where 7"i, . . . , Tfe G {erf 1 , . . . , &n-i}- We put 
ifi = 0j 4 if Tj = crj 4 or y9j = 0j- if 7j = cr~ . Then the embedding g = <p k ■ ■ ■ <p 1 : 
Y n -> F n induces a map SP m # : SP m F n 4 SP m F„ stratified homotopic to SP™/^. 
Hence Lr^ m (SP m /«) = Lt m (SP m g). It is immediate from the definitions of <f>i 
and thafFixDSP m # C V. 

Note that the components of U„ £ £ nm fl SP m <7 _1 (V^) are in one-one corre- 
spondence to the summands of the last expression in the following equation. 

(-l) m tr r ^ m Cn, m (/?) 
= (-l) m tr r(3m C„, m (ri)---C„, m (r fc ) 

E E 

(-l)-(-l)< + -+<sgn(7 7 1 ..-7 7 fc ).[na; 

Moreover, each of these components is homeomorphic to M 2m on which SP m (7 acts 
hyperbolically, hence gives rise to precisely one fixed point of SP m g, either in V or 
VnSP m ' m ~ Y n . In the former case, the coordinate of the fixed point corresponding 
to . . . , /i fc , 77 1 , . . . , 77 fc is precisely 

and, by Lemma 2.11, the index is 

sgn^ 1 ■ • -77*)- 

In the latter case, the corresponding summand is always collapsible. Therefore, 
from Lemma 3.6 the proposition follows. □ 

Remark 4.4. In fact, the configuration space y n>m has the homotopy type of a 
compact m-complex and the trace (— l) m trp„ m Cn,m{P) is nothing but the gener- 
alized Lefschetz number of a self map of the complex induced by DSP m fp. In 
this sense, the collapsible and peripheral terms in the trace both arise from the 
compactification issue. 



■ ■ TfeOI ( t-i h fc] 

LI II T) 
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5 Proof of main theorem 

According to Proposition 3.5 and Proposition 4.3, the (n + m)-strand forced exten- 
sions of a nontrivial braid (3 G B n are precisely those non-collapsible, non-peripheral 
terms in the trace trr„ m ( n ,m(P)- The following proposition states that these terms 
do not cancel in tr# n+m Cn,m(f3), hence eventually establishes Theorem 1.5. 

Proposition 5.1. Let (3 G B n be a nontrivial braid and suppose two extensions 
P',/3" G (3- ni{y ni m) of (3 are conjugate in B n+m . If (3' is forced by (3, then [(3'] and 
[(3"] have the same coefficient in L r/3 m (SP m fp). 

Proof. Assume f/3 = fp\mtY n : IR 2 \ P ^ IR 2 \ P is a minimal representative (in the 
sense of Theorem 2.3) in its isotopy class, and assume the term \(3'] in L rp m (SP m / '«) 
is the coordinate of the fixed point of DSP m fa corresponding to an /^-invariant 
set Q C int Y n = IR 2 \P. We extend fp to a homeomorphism : M 2 — > M 2 . Suppose 
the puncture point set P splits into a disjoint union of periodic orbits C\ U • • • U c s 
of and suppose Q splits into a disjoint union of periodic orbits d\ U • • • U df of <f>. 

The conjugation between (3 1 and f3" in B n+m gives rise to a homeomorphism 
i/j : E 2 R 2 , which preserves the set P U Q = c x U ■ ■ • U c s U d x U ■ • • U d t . Put 
(j)' = ip^ip' 1 . Since (3" restricts to (3 on the first n strands, 4>'\r2\p is isotopic to fp. 
Further, (j)'\^\p is also a minimal representative in its isotopy class. 

By conjugating (3" in Tp trn if necessary, we may assume d±, . . . ,d t are periodic 
orbits of 0'. Let nij be the period of di. Then 

ind(<r%^)) = ind(0 /m %^ +1 (rf,)) 

for all j and 

ind(0 m % ^(di)) = ind(0' m % i?{di)) 

provided that ipi(di) G {c±, . . . , c s }. 

Let Hi be the maximum positive number such that 

^(di),...,^- 1 ^) G {ci,...,c s }. 

Then 

{r i (di),---,r t (d t )} = {d 1 ,...,d t }, 

and, by induction, 

ind(0 m \^) = ind(0' m %^(^)). 

On the other hand, by Lemma 2.9 and Lemma 2.10, we have 

t 

md(DSP m Jp,[(3'}) = Hindis 

i=l 

t 

md(DSP m J p ,\p"}) = n ind (^' m %^)M- 

i=l 

Therefore, these two indices are identical. □ 
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6 Algorithms and examples 



Thanks to Theorem 1.5, the computation of the (n + m)-strand forced extensions 
of a given braid (3 G B n may proceed as follows. 

1. By means of the representation ( n , m , compute an initial formal sum for the 
trace tr Bn+m ( n , m (f3). 

2. Merge conjugate terms in the formal sum by solving conjugacy problem in 

B n -\- m - 

3. Identify collapsible terms and peripheral terms by computing reducing curves 
and drop them off. 

4. Return the nonzero terms remained after cancelation. 

In the procedure described above, one has to deal with two algorithmic prob- 
lems: conjugacy problem in the braid group B n+m and computation of reducing 
curves. Fortunately, there have been effective algorithms for both tasks. 

For the conjugacy problem, we refer the reader to a very efficient algorithm due 
to Gebhardt [11]. See also [4, 26] for improvements on this direction. 

As to the second problem, one solution is a braid algorithm due to Bernardete- 
Nitecki-Gutierrez [1]. It can be improved significantly if one computes the ultra 
summit set [11] or its variant [26] instead of the super summit set (see the references 
for details). An alternative solution is given by Bestvina-Handel [2], which is 
also applicable for general surface homeomorphisms but apparently less efficient, 
because it involves a computation of train-track maps. 

At the present time, we are not able to talk much about the computational 
complexity of the above procedure, partly because the topic of braid algorithms is 
a fairly new one and many questions still remain open. Nevertheless, the bulk part 
of running time is evidently spent in the second step. Hence it is a major issue to 
control the number of terms written down in the first step. 

A braid is called cyclic if it induces a cyclic permutation on the end points of its 
strands. We call an extension of a braid elementary if it is obtained by appending 
a single cyclic braid. 

Elementary forced extensions are the main concern of the braid forcing problem. 
Observe that the elementary extensions only constitute a small fraction of the terms 
in L r/3m (SP m fp). Hence in the first step of the above procedure we may drop off 
all non-elementary extensions of /3 to save considerably on running time. 

As another example of shortcut to facilitate the computation, when f3 is a 
pseudo-Anosov braid (the most significant case in dynamics), identification of col- 
lapsible and peripheral terms may be reduced by the following proposition to the 
reducibility problem of braids, for which a polynomial solution (for a fixed number 
of strands) has been claimed recently by Ko-Lee [19]. 
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Proposition 6.1. An extension (3' of a pseudo-Anosov j3 is collapsible or peripheral 
relative to (3 if and only if (3' is a reducible braid. 

Proof. Let be a Thurston representative determined by (3' . If (3' is not reducible, 
there are no reducing curves of <fr, hence (3' is neither collapsible nor peripheral 
relative to (3. Conversely, If (3' is reducible, each reducing curve of <fi must enclose 
either at most one of or all of the punctures corresponding to /3, because (3 is 
pseudo-Anosov. Hence (3' is either collapsible or peripheral relative to (3. □ 

Below we conclude this paper by presenting some examples. 

Example 6.2. Under the basis £3,2 = {(2,0), (1, 1), (0,2)} the representation £ 3i2 
of -B3 is given by the matrices (cf. the matrices of £3,2 from [25]) 



-A u A 15 a 4 -A 14 A 15 A 14 A 15 
(3,2(^1) = <n ■ I -A 15 A 15 (l - a 4 ) 

1 








-AT, 1 1 




cr 4 \ a 



1 5 



1 

(3,2(^2) = 0~2 ■ ( 1 - 04 -^24 

1 -^24 -^24^2504 



A^(l 



(7 4 



^24 








On 



A -1 A -1 n~ x A~ x A~ x 

^25 ^24 °4 ^25 ^24 



°4 ^25 ^24 



For reader's convenience, we illustrate by figures how to obtain the equality 

(1, 1) • (3,2(^1) = —o\A\<a ■ (1, 1) + a x A^{\ - a A ) ■ (0, 2). 

See Figure 7. The set V^i) consists of those points [xi,x 2 ] with Xi,x 2 G Y 3 po- 
sitioned as in the top left figure. Note that the set V(i,i) fl 1 ^ 1 (V(2,o)) is empty; 
V(i 3 i) fl 1 " 1 (V(i i i)) has one component, illustrated by the top right figure; and 
^(1,1) ( ~ | 1 ~ 1 (V(o i 2)) has two components, illustrated by the bottom two figures. From 
the last three figures one reads out A 15 , A 15 and v4 15 <t 4 , respectively. Together with 
the contribution of signs, they are assembled to give the above equality. 
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6 2 r t 61 



Y, 



0i(& 2 ) 0i (61) 



01 (7k) 




01 (62) 01 (6l) 




0l(?l) 



01 (62) 01 (6l) 




Figure 7: figures for computing (1, 1) • C3,2(o"i) 



Example 6.3. Under the basis £ n ^i the representation of B n is given by the 
matrices 

/ Ii-2 \ 

1 

1 

\ In-i-2 ) 

Note that if we replace Oi by 1 and replace by a number a, the representation 

specializes to the reduced Burau representation (ref. [3]) 



( h 



i-2 



\ 



1 
a —a 1 
1 



V 



In-i-2 / 

Example 6.4. For the simplest pseudo-Anosov braid j3 = o\o 2 x , we have 

^BsGAP) = tT B 5 (3,2(^1 )Cs,2(^ 1 ) 

= [a x ■ {-A 14 A 15 a 4 - A U A 15 A^(1 - a 4 ) 
+A U A 15 A^A^ + A 15 A^ 
+A 15 {1 - o 4 )ol x A- 2 lA- 2 l - al l A^A 2 l) ■ a 2 l ] 

= \/3- pA^A^a^ 1 - (3A u A lb a A - /3A£ - (3A 15 
+(3A^a 4 ~ 1 + (3A 15 a 4 + /3A 15 A£]. 

See Figure 8, in which the collapsible or peripheral strands are depicted as 
dotted lines. Clearly, the first five braids in the figure are reducible. An algorithmic 
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I \ N . 

i • • 



/^35 lj 434 1<J 4 1 



r 

/3Ai 4 A 15 (T4 




1 



7 



^ 




15 



/M 34 V 4 



i -i 



1 



/3Ai 5 cr 4 



Figure 8: the braids appearing in tr# 5 Cs^iP) for (3 = o\o 2 1 

test shows the last three are pseudo-Anosov. It follows from Proposition 6.1 that 
precisely the last three terms in tre 5 C3,2(/3) are neither collapsible nor peripheral. 
Therefore, up to conjugacy, there are a total of three 5-strand forced extensions of 
(3: pA^aX 1 , (3A lb a A and pA 15 A^. 

Example 6.5. Suppose /3 = &\ ■ • ■ cr ni Onl+i ' ' ' a nl+n 2 ^ &n where ni,n 2 > 2 and 
n — n\ + n 2 + 1. For 2 < m < min(rii, 77,2), we have 

tr B „ +1 c„,i(/5 m ) = \r - (PA 1>n+1 r - (PA^ +1 n 

tr Bn+m Cn,M = [13(1 ~ A hn+2 )(1 - A^ n+l )}. 

Either of the above formulae implies that the (pseudo-Anosov) cyclic braid (3 forces 
no m-strand cyclic braid (see [13, Theorem 7] for the case n 2 = m = 2). This 
contrasts sharply to Guaschi's theorem [12] which asserts that a pseudo-Anosov 
braid on three or four strands forces at least one m-strand cyclic braid for every 
m > 1. 

Without loss of generality, we sketch the computation of the above formulae for 
n\ = n 2 = m = 2. First, we translate the braid (3 = cxia^cr^V^ 1 G B 5 into the self 
embedding <fi : Y 5 —>■ Y5 depicted in Figure 9. 

Keep the notations of Section 4. There are a total of 11 components in V R 
_1 (V), so there should be the same number of nonzero terms in the matrix Cs,i(^) 
under the standard basis £ 5 1 



( 5 ,M = P 



fO A lfi A 2fi (-l + A^l) A lfi A 2fi A^ 6 \ 

1 n 4-1 



A*_ R (-1 + A7i) ^2,6^5.6 







.4 



5,6 








A 
-A 



5,6 
-1 
5,6 
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1 J 

0(C/i) (/>(U 2 



<f>(U 4 ) 



Figure 9: the map <fi : Y 5 



Y 5 representing (3 = a\a 2 a 3 V 4 1 



Since the matrix is almost upper triangular (this is quite evident for larger 711,712), 
the following trace can be computed without much difficulty. 

tr B6 C 5 ,i(/3 2 ) = [(3A lfi A 2fi {-l + A^)(3 + l3 2 A lfi A 2fi {-l + A^) 

+G&M-1 + AlDf - (PA^) 2 - (/M^) 2 + {(3Allf\ 
= [/3 2 - (f3A 1>e f - (PA^n 

In the equality, we used the identities PAi t Q = A 2 ^(3 and [/J^e-^ 13] = 

Next, we compute the second formula. The matrix £5,2 (/3) is a 10 x 10 one, 
but we are only concerned with its diagonal part. Notice that there are totally 10 
components in U M e£ S2 ^ ^ The trace is computed as 

tr B7 CbM = [~P^A lfi A 2fi (-l + A^) - pA 2fi A 2J a 6 

-(3A 2fi A 2J A^ 6 (l - a 6 ) + pA^A^iA^A^y 1 

-(3A 2J (-1 + A$)A£ 6 + P(A 5>6 A 5>7 y l a^ - (3(A 5>6 A 5>7 )- V^ 1 ]. 

On the right hand side, the six terms containing a^ 1 cancel pairwise, and we get 

= [-(3A 2fi A 2)7 A^l + /L4 2 , 6 A 2 , 7 (A B ,6A B ,r)- 1 - /3A 2J (-1 + A^ 7 )A^ 6 ] 
= - A 1>7 )(1 - A^)}. 
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